Electrophysiological correlates of reward prediction error recorded in the human prefrontal cortex.

نویسندگان

  • Hiroyuki Oya
  • Ralph Adolphs
  • Hiroto Kawasaki
  • Antoine Bechara
  • Antonio Damasio
  • Matthew A Howard
چکیده

Lesion and functional imaging studies have shown that the ventromedial prefrontal cortex is critically involved in the avoidance of risky choices. However, detailed descriptions of the mechanisms that underlie the establishment of such behaviors remain elusive, due in part to the spatial and temporal limitations of available research techniques. We investigated this issue by recording directly from prefrontal depth electrodes in a rare neurosurgical patient while he performed the Iowa Gambling Task, and we concurrently measured behavioral, autonomic, and electrophysiological responses. We found a robust alpha-band component of event-related potentials that reflected the mismatch between expected outcomes and actual outcomes in the task, correlating closely with the reward-related error obtained from a reinforcement learning model of the patient's choice behavior. The finding implicates this brain region in the acquisition of choice bias by means of a continuous updating of expectations about reward and punishment.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Neural coding of distinct statistical properties of reward information in humans.

Brain processing of reward information is essential for complex functions such as learning and motivation. Recent primate electrophysiological studies using concepts from information, economic and learning theories indicate that the midbrain may code two statistical parameters of reward information: a transient reward error prediction signal that varies linearly with reward probability and a su...

متن کامل

Reinforcement learning models and their neural correlates: An activation likelihood estimation meta-analysis.

Reinforcement learning describes motivated behavior in terms of two abstract signals. The representation of discrepancies between expected and actual rewards/punishments-prediction error-is thought to update the expected value of actions and predictive stimuli. Electrophysiological and lesion studies have suggested that mesostriatal prediction error signals control behavior through synaptic mod...

متن کامل

Neural correlates of frustration.

Psychological considerations suggest that the omission of rewards in humans comprises two effects: first, an allocentric effect triggering learning and behavioural changes potentially processed by dopaminergic neurons according to the prediction error theory; second, an egocentric effect representing the individual's emotional reaction, commonly called frustration. We investigated this second e...

متن کامل

Functions of Learning Rate in Adaptive Reward Learning

As a crucial cognitive function, learning applies prediction error (the discrepancy between the prediction from learning and the world state) to adjust predictions of the future. How much prediction error affects this adjustment also depends on the learning rate. Our understanding to the learning rate is still limited, in terms of (1) how it is modulated by other factors, and (2) the specific m...

متن کامل

Prediction error for free monetary reward in the human prefrontal cortex.

Making predictions about future rewards is an important ability for primates, and its neurophysiological mechanisms have been studied extensively. One important approach is to identify neural systems that process errors related to reward prediction (i.e., areas that register the occurrence of unpredicted rewards and the failure of expected rewards). In monkeys that have learned to predict appet...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:
  • Proceedings of the National Academy of Sciences of the United States of America

دوره 102 23  شماره 

صفحات  -

تاریخ انتشار 2005